DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Video

نویسندگان

چکیده

For few-shot learning, it is still a critical challenge to realize photo-realistic face visually dubbing on high-resolution videos. Previous works fail generate high-fidelity results. To address the above problem, this paper proposes Deformation Inpainting Network (DINet) for dubbing. Different from previous relying multiple up-sample layers directly pixels latent embeddings, DINet performs spatial deformation feature maps of reference images better preserve high-frequency textural details. Specifically, consists one part and inpainting part. In first part, five facial adaptively perform create deformed encoding mouth shapes at each frame, in order align with input driving audio also head poses source images. second produce dubbing, decoder responsible incorporating movements other attributes (i.e., pose upper expression) together. Finally, achieves rich We conduct qualitative quantitative comparisons validate our The experimental results show that method outperforms state-of-the-art works.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Video Subject Inpainting: A Posture-Based Method

Despite recent advances in video inpainting techniques, reconstructing large missing regions of a moving subject while its scale changes remains an elusive goal. In this paper, we have introduced a scale-change invariant method for large missing regions to tackle this problem. Using this framework, first the moving foreground is separated from the background and its scale is equalized. Then, a ...

متن کامل

A Temporally-Aware Interpolation Network for Video Frame Inpainting

We propose the first deep learning solution to video frame inpainting, a challenging instance of the general video inpainting problem with applications in video editing, manipulation, and forensics. Our task is less ambiguous than frame interpolation and video prediction because we have access to both the temporal context and a partial glimpse of the future, allowing us to better evaluate the q...

متن کامل

Video Inpainting

This Video inpainting is an important video enhancement technique used to facilitate the repair or editing of digital videos. In this paper, we propose a video inpainting algorithm for repairing damaged content in digitized video films, focusing on maintaining good spatiotemporal continuity. The proposed algorithm utilizes key techniques.

متن کامل

Image Inpainting for High-Resolution Textures using CNN Texture Synthesis

Deep neural networks have been successfully applied to problems such as image segmentation, image super-resolution, coloration and image inpainting. In this work we propose the use of convolutional neural networks (CNN) for image inpainting of large regions in high-resolution textures. Due to limited computational resources processing high-resolution images with neural networks is still an open...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i3.25464